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Abstract. The Hamiltonian-Krein (instability) index is concerned with determining the number of eigen- 
values with positive real part for the Hamiltonian eigenvalue problem JCu = Xu, where J is skew- 
symmetric and £ is self-adjoint. If J has a bounded inverse the index is well-established, and it is given 
by the number of negative eigenvalues of the operator C constrained to act on some finite-codimensional 
subspace. There is an important class of problems - namely, those of KdV-type - for which J does not have 
a bounded inverse. In this paper we overcome this difficulty and derive the index for eigenvalue problems 
of KdV-type. We use the index to discuss the spectral stability of homoclinic traveling waves for KdV-like 
problems and BBM-type problems. 
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1 . Introduction 

We consider the spectral problem of the form 

d x £u = Am, (1.1) 

where £ is a self-adjoint linear differential Fredholm operator with zero index and with domain D(£) = 
H S (IR) for some s > 0. Eigenvalue problems of this type readily arise, e.g., when considering the stability of 
waves to KdV-like problems. We will furthermore assume that £ = £q + JC, where K, is relatively compact 
perturbation of £ , and £ is a "constant coefficient" strongly elliptic operator 1 given by £ f(E,) = q(E,)f(E,). 
It will be assumed that for the operator £, 

(a) there are n(£) < +oo negative eigenvalues (counting multiplicity), and each of the corresponding 
eigenvectors belong to H 1/2 (IR). 

(b) ff ess (£) = 0ess(£o) = Range(g) c [k 2 ,+oo),k > 

(c) dim[ker(£)] = 1 with ker(£) = span{i/> ), and ip is real-valued and ip £ H°°{1R) n H _1 (E). 

For the precise definitions of the various Sobolev spaces, consult Section 2. 

The goal of this paper is to compute an instability index, hereafter known as the Hamiltonian-Krein 
index, for the eigenvalue problem (1.1). In the derivation of instability indices for eigenvalue problems of 
the form 

J£u = Aw, 

where J is skew-symmetric and £ is symmetric, it was crucial in previous works that J have a bounded 
inverse on (at minimum) a finite co-dimensional space (e.g., see [6, 8, 11, 12]). Define the standard inner- 
product on L 2 (IR) by 

(f>g) = f(x)g(x)dx. 

<J—oo 

It is clear that the operator d x is skew-symmetric on L 2 (1R); however, it does not have a bounded inverse. 
This is a reflection of the fact that a{d x ) = o ess (d x ) = ilR. The aim of this paper is to overcome this obstacle. 
Briefly, this will be accomplished by reducing the eigenvalue problem (1.1) to an equivalent problem for 
which the operator J does have a bounded inverse. However, by doing so it will be the case that for the 
new operator £: 

(a) the essential spectrum will (generically) be [0, oo+), which violates the assumption present in the 
original computation of the Hamiltonian-Krein index that the essential spectrum be bounded 
away from the origin 

(b) the negative index of the new £, which is needed in the evaluation of the index, is not obvious. 

Both of these obstacles must be overcome before coming to the final conclusion of Theorem 4.3. 

The paper is organized in the following manner. In Section 2 we discuss some preliminary ideas which 
will be needed in the analysis. The results presented therein are not new, and are included solely to help 
make the paper more accessible. In Section 3 the equivalent eigenvalue problem is derived, and properties 
of the new operator £ are given. Section 4 contains the main result of the paper. In Section 5 we give a 
couple of applications of the theoretical result, and compare the results here with what is already known 
in the literature. 

Acknowledgments. TK gratefully acknowledges the support of the Jack and Lois Kuipers Applied Mathe- 
matics Endowment, a Calvin Research Fellowship, and the National Science Foundation under grant DMS- 
1108783. AS research is supported in part by NSF-DMS 0908802. 
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2. Preliminaries 

Define the Fourier transform and its inverse via the formulas 

/(£) = f f(x)e- 2nixi dx, f(x)= f /(£)e 2ni ^d£, 

which are valid for functions in the Schwartz class S. Introduce fractional order differential operators via 
the Fourier transform, i.e. for s > 0, 

\d^f(^):=(2nm s f(a 
The norm of the Sobolev space H S (]R), s > 0, is given by 

II/IIh* :=(Jj/(£)| 2 (l+<S 2 ) s d<S 

The space of infinitely smooth functions (with L 2 (1R) decay of all derivatives), H°° := D^L 1 H S is not a Banach 
space, but it has a well-understood Frechet space structure. 

We also need to consider operators in the form for some a > 0. Regarding Sobolev spaces of 

negative order, we introduce the norm 

and say that a Schwartz function / belongs to H~ a (IR) if ||/||^-n is finite. The Banach space H~ a (M) is 
obtained as the completion of the Schwartz class S in this norm. Note that the Sobolev spaces of negative 
order will in general contain distributions 2 . Further note that 

(a) \d x \~" : H~ a {]R) L 2 (IR) is an isometry 

(b) \d x \ a : L 2 (R) H- a (R) is an isometry. 

Some of these operators have a nice representation as fractional integrals. For example, (again for Schwartz 
functions) 

S7m jR\x-y\ 1/2 

in particular, \d x \~ 1,,2 f is real-valued if / is. Note that unless / has extra cancellation properties 3 , then for 
large values of x one has |oy -1 ^ 2 / ~ I*! -1 / 2 and hence \d x \~ l ^ 2 f € L 2 (IR). 
Finally, note that for / e H -1 (1R) we may define the operator o*" 1 via 

The operator d~ l is skew-symmetric, as may be seen by the Plancherel's theorem. In particular, for ev- 
ery real-valued / e H _1 (IR) n L 2 (TR) we have that (d~ l f,f) = 0. One may identify H _1 (IR) as the space of 
distributional derivatives d x (L 2 (1R)) c S'. More precisely, 

H" 1 (K) = d x (L 2 (TR)) = {h: h = d x feS',fe L 2 (E)}, \\h\\^ d := ||/|| L 2. 



2 In fact, one may define H~ a as the dual space to H a , with the obvious definitions. In doing that, one needs to be careful since the 
"norm" || • \\fja assigns zero value to the constant functions and thus, those functions need to be mod-ed out. 
^At a minimum J/ = 0, but actually more, like / £ (JR) - the Hardy space on the line 
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2.1. Littlewood-Paley operators 

Let C 6 C^°(IR) be a positive and even cut-off function which satisfies 



C(z) 



1 1, Izl < 1 
I 0, Izl > 2. 



For a > define the Littlewood-Paley operator P <a via 

pZf(z) = t(Ua)f(a 

Naturally, we take P> a = X - P <a , where X is the identity operator. The related operators P_ fl are defined 
via JL fl := P <a - P<«. Alternatively, let cp(z) := C(z) - C(2z) and let PZj{E) = <p(£/a)/(£). Note that by the 
Hardy-Littlewood-Sobolev inequality, we have for all 1 < p < oo 

inwib + inwib + \p~af\y < c(i + nciiti in/lb. 

We will often denote 4 

f<a := P<af> f>a := P>af > f~a ~ P~af ■ 

Note that the operators P_ fl provide a useful partition of unity Indeed, note that Lr=- M ?'^~^) = 1 f° r 
£ * 0, and as a consequence 

oo oo 
k=-oa k=l 

A version of the Sobolev embedding estimates (also known as Bernstein inequalities) is given by 

HPWIb < C2 k{L p-l ] \\f\\ LP . (2.1) 

for all 1 < p < q < oo. 

We have the following lemma: 

Lemma 2.1. The subspace {\d x \ l/2 g : g € H 1/2 (R)} is dense in L 2 (R). 



Proof: Let £ > and / e L (R) be given function. Then there exists b > so that 
Define 



J-i 



(ccO, \S\<6 
'~\f(Z)/y[2m, \Z\>o. 



It follows that g £ H^K) - in fact, |||3 x | 1/2 g||^ = Jj 5|>a l/(£)I 2 <U < ||/|| 2 2 - while ||^|| 2 2 < \\f\\ 2 L2 /{2nb). In 
addition, by Plancherel's 

\\f-\d x \ 1/2 g\\ 2 L 2= P|/(5)| 2 df <e 2 . □ 
J-d 



By slight abuse of notations, we will always use /L„(£) := 0(f /a)/(<5) and O is supported around 1 smooth function 
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3. The equivalent eigenvalue problem 



3.1. The reformulation 

We proceed with the reformulation of the eigenvalue problem (1.1). We first note that for nonzero eigen- 
values it will necessarily be the case that u e H _1 (1R) if u e D(£) = H S (M). Indeed, from (1.1) 

IMIh-i = i^jll £M Hi. 2 - 

This observation motivates the following change of variables. Set 

u = \d x \ 1/2 v v = \d x \- l,2 u. 

Note that v e H" 1/2 (IR) n H S+1/2 (IR), since \d x \~ 1/2 : H'^M) n H S (M) H" 1/2 (E) n H S+1/2 (E) is a bounded 
map. The eigenvalue problem for v becomes 



d x \d x r /z c\d x \^v=xv, 

which can be massaged to 

d x \d x \- l -\d x \ l/2 C\d x \ l/2 v = Av. 

Upon introducing the new operators 

J:=d x \d x \~\ £* := \d x \ l/2 £\d x \ l/2 , (3.1) 

we now see that (1.1) for u e L 2 (R) can be rewritten as 

J£ <> v = Xv, veH- 1/2 (M)nH s+1/2 (M). (3.2) 

Consider the operator £*. Clearly, while (3.1) specifies the action of on smooth vectors, it does 
not address the important issue of whether or not is self-adjoint 5 . For this, one needs to specify a 
domain. We would like to point out that there are several (potentially different ways) to obtain a self-adjoint 
extension. For the purposes of this section, we proceed in a canonical way, by building the Friedrich's 
extension. We will however give a more direct construction in Section 5. We follow the arguments in [18, 
Theorem VIII. 15]. More concretely, consider the bilinear form 

q(f,g) ■■= {\d x \ m C(\d x \ m f ),g) = (£\d x \ U2 f,\d x \ 1/2 g). 

According to [18, Theorem VIII. 15], if we show that the quadratic form q is semi-bounded (that is q(/,/) > 
-M||/|| 2 for some M), then q is the quadratic form of an unique self-adjoint operator, the Friedrich's exten- 
sion, which we call again with domain D(£°) = {/ e H S+1 (IR) : £*/ e L 2 (IR)} c H S+1 (IR). Let {fj}f =1 be a 

normalized basis of the finite-dimensional negative subspace of £, i.e. Cfj = -ft 2 fj,j = l,...,N. In order to 
show the semi-boundedness of q, decompose 

N N 

\d x \ 1/2 f = h + J^(\d x \ 1/2 f,f j )f j =h + Jjf,\d x \ 1/2 f j )f j , 

;=1 ;=1 
where (£h,h) > 0, since h e spanf/j,...,/^]- 1 -. We have that 

N 

q(/,/) = (£|5 x | 1/2 /,|5 x | 1/2 /) = {Ch,h)-J^} t 2 {f,\d x \ 1/2 fj) 2 > -MH/II 2 , 



3 even though it is clearly a symmetric operator 
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where M = Nsup^^ N ](^||/y||^ 1/2 ). Thus, we have constructed the Friedrich's extension of £* by virtue of 
[18, Theorem VIII. 15]. 

Next, several comments are in order regarding the operator J, Not only is this operator skew-symmetric 
on V (IR) for any 1 < p < +oo, it is a classical operator, well-studied in the literature; namely, the Hilbert 
transform. It can be alternatively defined (on Schwartz functions) via the formula 

J/(5) = -isign(5)/(5), 

or it can be defined as the singular integral 

Jf(x) = -p.v. PM d y. 

Unlike the operator d x , the Hilbert transform is a bounded operator on a variety of function spaces; in 
particular, on all L p (M) for 1 < p < +oo. Furthermore, on L 2 (IR) it is the case that J : L 2 (M) H> L 2 (IR) is an 
isometry with (J)" 1 = -J [13, Chapter 16.3.2]. 

We will concentrate our interest on the spectral stability /instability of the linear system (1.1). We say 
that the linearized problem (1.1) is (spectrally) unstable if there is a A with positive real part and a cor- 
responding function u 6 D(L) n H°°(1R) D H _1 (1R) so that (1.1) is satisfied in classical sense. Otherwise, 
the problem is spectrally stable. Clearly, spectral instability/stability is equivalent to the existence (non- 
existence, respectively) of solutions v to (3.2) with Re A > 0. In conclusion, the eigenvalue problem (3.2) 
is the correct one to study in order to apply the previous Hamiltonian-Krein (instability) index theorems. 
The application of these theories will require a careful study of the operator £°. 

3.2. Relation between the point spectrums of C and 

Before we relate the negative spectrum of the sandwiched operator £* to that of £, we must first understand 
the kernel of £*. 

Lemma 3.1. Regarding the operator £* we have that dim[ker(£*)] = 1 with ker(£*) = span{|^|- 1/2 ^ }- 
Proof: Since ip 6 H _1 (1R) n H°°(K), it is the case that \d x \~ 1/2 ip e H" 1/2 (IR) n H°°(E). Since 

c\d x \ l/2 (\d x \- 1/2 ^ ) = C4> = o, 

it is then clear that dim[ker(£ <> )] > 1. In order to determine if the kernel is any larger, consider £*« = as 
an equality of L 2 (1R) functions. Testing this equation against all functions v e H^ 2 (1R) yields 

<£V^> = {\d x \ l/2 C\d x \ m u,v) = (C\d x \ l/2 u,\d x \ l/2 v) = 0. 

Because of the density Lemma 2.1 we can rewrite the above as 

(C\d x \ 1/2 u,w) = 0, weL 2 (M). 

Consequently, it must be the case that (as an equality of L 2 (1R) functions) 

£|^| 1/2 w = u = c\d x r V2 ip . 

The desired conclusion has now been achieved. □ 

Now that we see the kernel of the sandwiched operator is no larger than the kernel of the original 
operator, the next thing to be understood is the generalized kernel of JX*, gker( t /£' > ). 

Lemma 3.2. Suppose that ip e H _1 (IR) satisfies 

(£- 1 (a;Vo),^Vo>^o. 

The generalized kernel is then given by 

gker(J£*) = spanil^r 1 / 2 ^,!^!- 1 ^-^- 1 ^}- 
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Remark 3.3. Since £ has a nontrivial kernel, it is not clear that the expression £~ 1 (d~ 1 xpo) is valid. Since 
d^} is a skew-symmetric operator, it is the case that (d~ l ip$,ipo) = 0. The fact that £ is self-adjoint, and the 
additional fact that d~ l 6 ker(£) x , then tells us that the expression makes sense. 

Proof: Since J has bounded inverse, we know from Lemma 3.1 that ker(J" '£*) = span{|o' t |~ 1 ^ 2 !/'o}- The first 
element in the generalized kernel is then found by solving 

J£»u = \d x \- 1/2 ip => £\i=\d x \ 1/2 d- 1 ip . 

Since i[>q e H -1 (IR), the expression on the right makes sense. We would like to begin to use the Fredholm 
solvability theory at this point, but unfortunately the fact that the origin is not necessarily isolated from the 
(essential) spectrum of £* means that this is not possible. However, the form of £* means that the above is 
equivalent to 

\d x \ l/2 c\d x \ 1/2 u = \d x \ 1/2 d- x 1 i> ^ c\d x \ l ' 2 u = d~ 1 ^. 

The equality on the right follows from the fact that if |oy^ 2 G = for an L 2 function G (in the sense of 
distributions), then G = 0. Since d^tyo e ker(£) x , by the Fredholm solvability theory the above has a 
solution. The second element in the Jordan chain is given by 

u = \d x \- 1/2 £- 1 d-^ . 

The result is proven once it is shown that the Jordan chain is no longer. Upon continuing we see that 
the next element in the Jordan chain, if it exists, is found by solving 

J£*u = \d x \- 1/2 £- 1 d- x 1 f £\d x \ y2 u = dr x l £- l dr x 1 ^. 

The Fredholm solvability theory requires that 

= (3?£T l 3?Mo) = -{£- l d- l %,d~ l xp Q ). 

By assumption this equality cannot hold, which completes the proof. □ 

Now that the structure of the kernel is well-understood (a crucial ingredient in the index theories), we 
now turn to the problem of the negative index for the operator say n(£*). In general, we let n(S) denote 
the number of negative eigenvalues (counting multiplicity) of the self-adjoint operator S. Recalling the 
assumption (b) on the essential spectrum of £, we have the following: 

Lemma 3.4. Assume that a ess (£*)\ c [0,+oo). Ifn{£) < +oo, then n(£) = n(£*). 

Proof: Let n(£) = N, let -A 2 ^ < -A 2 ^_ 1 < ••• < -A 2 < denote the negative eigenvalues, and let fi,...,f N 
denote the corresponding eigenfunctions. As a consequence of the Courant max/min principle it is known 
that 

/ x espan{/i,...,/ N } x <£/\/ x ) > 0. 

Set gj = \d x \" 2 fj, and let g 1 - e spanj^,...,^}- 1 be given. For each ;' = l,...,N we have 

<\dx\ 1/2 g L ,fj) = <g L ,gj) = 0, 

so that \d x \ g" 1 G spanj/i,...,/^}- 1 . Consequently, we have that 

(£\d x \ 1/2 g^,\d x \ 1/2 g^)>0 => <£V^ X )>0. 

In other words, the negative subspace of £*, i.e., the subspace of £* which corresponds to the negative 
eigenvalues of £°, must be a subspace of the negative subspace of £. In conclusion, we have that n(£*) < N. 

Now that it is known that n(£*) is finite, assume that n(£*) = M. Equality of the two indices for M = 
follows immediately from Lemma 2.1, so assume M > 1. We first show that all eigenfunctions of £* corre- 
sponding to non-zero eigenvalues belong to H _1 ^ 2 (IR). Indeed, let pi * be an eigenvalue, with eigenfunction 
f , so that 

F f=£«f = \d x \ 1/2 (£\d x \ 1/2 f). 
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Since \d x \ 1 ^ 2 : L 2 (IR) h^> H 1/,2 (IR) is an isometry, the result now follows. 

Next, let fi, . . . ,/m be the normalized eigenf unctions of which correspond to the negative eigenvalues 
-H 2 M < -li 2 N _ x <---<-n\< 0. For ; = \,...,M set gj = \d x \~ xn f ] e L 2 (IR) (in fact \\ gj \\ L 2 = and fix 

g e span{g 1 ,...,g M } ± so that \\g\\ns < 1. For < e « 1, we have 

(£g>g) = (£g> £ 'g>e) + 2(£g>e>g<e) + (£g<e>g<e)- 
By using Cauchy-Schwartz the latter two terms can be bounded via 

2\(Lg>e,g<s)\ + \(Lg< £ ,g<e)\ < C\\g\\ H s\\g< E \\ L 2 = C\\g< E \\ L 2, 
where we have used that 6 ||£g||x,2 < C||g||#s Regarding the first term (£g >E ,g >E ), write 

(£g>e,g>e) = {C\d x \ 1/2 \d x \- l/2 g> E ,\d x \ y2 \d X V V2 g>e) = (£*\d x \- X/2 g>e,\d x r 1/2 g>e) 
Projecting \d x \ 2 g >E over the spectrum of yields 

M 

\d X \- y2 g>e = K + Yj\d X r m g>e.m, 

where (£ <> h £ ,h £ ) > and h e € span{/i, . . . , /m} -1 . Since 

= (g,gj) = (\d x \- 1/2 fj,g >E ) + (gj,g< £ ) = (fj,\d x \- 1/2 g>e) + (gj,g< £ ), 
we can rewrite the above expansion as 

M 

\d x \- 1/2 g>e = h E -J^(gj>g<e)fr 

;'=i 

It then follows that 

M 

{C*\d x \- x/2 g >E ,\d x \- l/2 g >E ) = (£*h e ,h e ) - Y^i* 2 \(gj,g<e)\ 2 . 

;'=i 

Using the definition of we can rewrite the above as 

M 

(£g>a,g>e) = (&h e ,h e ) - J^Fj\<gj>g<e)\ 2 - 

;=i 

Again using Cauchy-Schwartz we have that \(gj,g< E )\ < \\gj\\L 2 \\g<e\\L 2 - C\\g<e\\L 2 > where 
C = sup j e [im ||/ ; |Ih-i/2. It follows that 

<L£ >£ ,£ >£ >><£%A>-C||s< f || L 2. 
In addition, note that by Cauchy-Schwartz 

(£g<e>g< E ) ^ ll^feelbllfeelb ^ C||^< f || HS ||^< £ || L 2 < C||g<J 2 2 . 
Putting everything together yields 

(Lg,g)>-C\\g< E \\ L 2(l+\\g< E \\ L 2). 

Since e > is arbitrary and lim^o II&seIIl 2 = 0' ^ must then be the case that (Cg,g) > 0. This inequality 
implies that n(£) < M = n(£*). The proof is now complete. □ 



Note that we assume that C : D(C) c H s — > L 2 and hence the estimate ||£g||£2 < CHgH^fs 
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3.3. An example 

In the previous section, we have considered the theoretical relation between the spectral properties of £ 
and £*. We would like now to explore it further for a specific example. 

Proposition 3.5. Let V : 1R — » ]R be C 1 smooth and (sufficiently) decaying potential. Consider the corre- 
sponding Schrddinger operator £ '.- —d 2 + c - V, with c > and D(£) = H 2 (IR). The sandwiched operator 
£« ■- \d x \ 1/2 £\d x \ 1/2 with domain D(£°) = H 3 (IR) is self-adjoint, and moreover ff ess (£*) = [0,°°), while n(£°) = 
n(£) < oo. 

Proof: One could argue that the Friedrich's extension of £* is self-adjoint, after which, one will need to 
identify the domain as H 3 (IR). We will instead follow a more direct route in constructing a self-adjoint 
extension of the symmetric operator £°. To that end, let 

£* = \d x \ m £\d x \ m = -\d x \d 2 x + \d x \ 1/2 V\d x \ 1/2 = \9 X \ 3 + \d x \ x/2 V\d x \ l/1 =: C> + JC\ 

where D(C%) = H 3 (IR), D(/C°) = H X (M). Clearly, with these assignments, £^ is self-adjoint, while K? is a 
symmetric operator. Furthermore, ct(£q) = ff ess (£g) = [0,oo). 

According to the Weyl's essential spectrum theorem (and more specifically [17, Corollary 2, page 113]), 
we may conclude that £* = £q +K,° is self-adjoint and cr ess (£ <> ) = cr ess (£g) = [0, oo) provided we can establish 
that JC is a relatively compact perturbation of £q. This amounts to showing that 

\d x \ 1/2 V\d x \ 1/2 (i + Icy 3 )" 1 : L 2 (1R) ^ L 2 (M) is compact. 
Since it is clear that \d x \ 1/2 V\d x \ V2 {i + |5 X | 3 ) -1 e B(L 2 (E)), it will suffice (by Relich's criteria) to establish 

\d x \ 1/2 V\d x \ 1/2 (i + l^l 3 )" 1 : L 2 (K) -> H 1/2 (K) (3.3) 

ii^i^vidxi^a+idxPrvwi^-Srii/ib. w»i. (3-4) 

y\x\ 

For the proof of (3.3), we have 

iii^i 1/2 v|5j 1/2 (i + i5j 3 rViiH 1 / 2 ( E) = ii^Jv'|5j 1/2 (i + |5j 3 )-V]ii L2(K) 

<l|V / || L »|||5 J£ | 1/2 (i + |5 J£ | 3 r 1 /lb+ 

imiL~iRi 3/2 (i+i<y 3 r7i^ 

^C(||V'|| I - + ||V|| I -)||/|| i 2. 



For the proof of (3.4), first fix x with \x\ » 1. Denoting h(x) = \d x \ 1/2 (i + \d x \ 3 )" l f and G(x) = V(x)h(x), write 
l^| 1/2 V\d x \ l/2 (i + \d x \ 3 )- l f(x) = J |£| 1/2 G(5 )e 2 ™« dx 

= V2^ ^ 2* /2 <p(2-^)G(£)e 27li ^dx, 

ic=-co 

where (f>(z) = \z\ l ^ 2 <p(z). For the portion of the sum k with 2 k < |x| _1 , we have 



i (p(2-^)G(£)e 27ti ^dx<C|xr 1/2 sup||G^|| L co <C|x|- 1/2 ||G|| LOO <C|xi" ] 

k:2 k <\x\ 



By Sobolev embedding, for any m > 1/2, \\h\\ L °* < C m \\h\\ H m < C||/|| L 2. Regarding the case of k with 2 k > \x\ 1 
we integrate by parts to get 

J <p(2-^)G(£)e 2 ^ dx = JL i 2 -k J <p'( 2 -^)G(£)e 2 ™« dx + J <p(2-^)G'(£)e 2 ™« dx). 
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The first term is estimated via 

2~M 



j-k/2 f 

JLl^J <P'(2"^)G(5)e 2 ^dx 



k:2 k >\x\- 1 



< Clxr 1/2 supl|G^ 2 tl| L », 

k 



whence the estimate finishes as the one a few lines up. Finally, upon introducing the smooth function 
O(z) = cp(z)/z, rewrite 



<p(2- k l)G\l)e 2nixl dx = 2- k I ®(2- k ZMG'(Z)]e 2mxt dx. 



so that 



y — f 



0(2"' c e)[5G'(5)]e 27ti ^ dx 



k:2 k >\x\- 1 



< C|x|- 1/2 sup||H^|| L „ < C\xV\\H\\ L . 
k 



-1/2, 



where H is defined through its Fourier transform, H(£) := £G'(£). From the formula for H one can easily 
identify it; namely, H(x) = CQd x (xV(x)h(x)) for some constant cq. Finally, by Holder's inequality and Sobolev 
embedding we conclude with 



||H|| L „ < C(\\xV(x)\\ L oo + \\xV'(x)\\ L <* + ||V|| L «)(P|| L » + < C V ||/|[ L 2. □ 



4. The Hamiltonian-Krein index theorem 

We are now ready to apply the instability index formula of [11, 12]. For the reformulated eigenvalue 
problem (3.2) let k r denote the number of real-valued and positive eigenvalues (counting multiplicity), and 
let k c be the number of complex-valued eigenvalues with positive real part. Since the imaginary part of 
£ satisfies Im(£) = 0, it is the case that k c is an even integer. Finally, for (potentially embedded) purely 
imaginary eigenvalues A e ilR, let Ex denote the corresponding eigenspace. The negative Krein index of the 
eigenvalue is given by 

k.(X)=n((C\ x u,u)), 
and the total negative Krein index is given by 

kr=J^kr(X). 

Here we use the notation S\e = PeSPe, where Pe is the orthogonal projection onto the subspace E. It is the 
case that k[ is also an even integer. The Hamiltonian-Krein index is defined by 

^Ham : = k T + k c + ki: 
the index counts the total number of (potentially) unstable eigenvalues. 

Remark 4.1. The negative Krein index of the operator is defined in terms of the the eigenvalue problem 
(3.2). Using the definition of it can be rewritten as 

kr{\) = n{{C\ Bx \d x \ m u,\d x \ m u)). 

In terms of the original eigenvalue problem (1.1), upon using the transformation that moved the first to the 
second yields that in terms of the original variables, the negative Krein index can be rewritten as 

k-(X) = n({C\ Ex u,u)). 

This is the expected definition, and the one that would have been used if the operator d x had bounded 
inverse. 
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For the eigenvalue problem (3.2) the previous index theory relates K Ham to the finite number n(£*|s±), 
where S is some finite-dimensional subspace. In order to apply this theory, however, it is not only necessary 
that J have bounded inverse, but that ff ess (£*) be uniformly bounded away from the origin. Unfortunately, 
this technical assumption is no longer necessarily valid, as in the applications it will generically be the 
case that the essential spectrum touches the origin, i.e., a^{C?) = [0,+oo) (e.g., see Proposition 3.5). We 
overcome this technical difficulty with the following argument. 

For < e <<c 1 consider the sandwiched operator 

d := (_^ + e 2 ) i /4 £(-^ + e 2 ) i/4. 

Note that = £g, and moreover £ £ — » as e — » + in the weak operator topology. That is, for each pair 
of test functions x> l P> 

lim(£^^) = (£^^) (4.1) 

e— >0 

Since the operator (- d 2 + e 2 ) 1/4 is invertible for any e > 0, 

n(£*) = n(£); 

thus, by using Lemma 3.4 we have the double equality 

n(4)=n(£)=n(£% (4.2) 

Regarding the essential spectrum, we would like to say that it is pushed off the origin and becomes 
<r ess (£*) c [k 2 c,+oo). This is indeed the case, but it needs some justification. 

Proposition 4.2. The essential spectrum of the sandwiched operator satisfies 

a ess (£l)<Z[K 2 e,+oo). 

Proof: Recall that by assumption C = £q + K, where JC is relatively compact perturbation of Cq > k 2 1. In 
particular, C is invertible and JCCq 1 is a compact operator. Denote 

4 = {-dl + e 2 ) 1/4 £ (-^ + e 2 ) 1/4 ; t £ = (-dl + £ 2 ) 1/4 /C(-^ + e 2 ) 1/4 , 

so that = L e + K, e . By applying the Fourier transform, we see that 

^(4) = ff eS s(4) = Range[^ ^ (4n 2 ^ 2 + e 2 ) 1/4 q(£)(4n 2 Z 2 + e 2 ) m ] c [k 2 £,oo), 

since by assumption q(£) > k 2 . Thus, it remains to show 

a ess (C £ + K, £ ) = a ess (C e ). (4.3) 

In order to show (4.3), we will verify that (C £ + 1C £ + i) -1 - (C e + i) -1 is a compact operator, whence the result 
will follow from a standard lemma in spectral theory [17, Corollary l,p. 113]. Indeed, 

£-^ £ £^ = (-d 2 x + e 2 )-^IC£- H-d 2 x + e 2 )-^ 

is compact, since ICCq 1 is compact by assumption. A multiple application of the resolvent identity yields 
the formula 

(4 +t e + iy l t e (c e + i)- 1 = [(4 1 - (4 + 1 £ + iy l {£ £ + i)t- £ l ]t £ [{c- £ l + ic- £ l {l e +i)- 1 ], 

which implies that (£ £ +IC £ + \)~ l JC £ (C £ + i) -1 is compact as well. From the resolvent identity again, 

(4 + K + ir 1 - (4 + i)" 1 = -(4 + £ e + i) -1 ^ e (A + 

which implies the compactness of (4 + 4 + i) -1 _ {£-e + i) 1 ' an d hence (4.3) is established. □ 

7 In fact, one might argue as in Lemma 3.4 that for each e > 0, n(C%) = n(£) 
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For Hamiltonian eigenvalue problems the Hamiltonian-Krein index theory can be applied if the skew- 
operator has a bounded inverse, and if the self-adjoint operator (a) has a finite number of negative eigen- 
values, and (b) has an essential spectrum which is bounded away from the origin. Thus, this theory is 
applicable for the operator J L\ for any e > 0. We now wish to establish the index for the one-parameter 
family of eigenvalue problems given by 

JClu = Xu => L <> e u = XJ- 1 u. (4.4) 

Afterwards, we will use a limiting argument to establish the index for the original problem (1.1). 

Since ker(£*) = span{(-d 2 + e 2 )" 1/4 !/; }, and since is self-adjoint, for A # the eigenvalue problem 
(4.4) can by the Fredholm alternative have a solution if and only if 

(J- l u,(-d 2 x + e 2 )- 1/i il )0 ) = => (u,(-d 2 x + e 2 )- l/4 \d x \d- x 1 4> ) = 0. 

Thus, upon setting S £ := span{(-d 2 + e 2 )~ l ^\d x \d~ l \po\, the search for nonzero eigenvalues is accomplished 
by considering the constrained problem 

JC\u = Am, u € S^. (4.5) 

As a consequence of [11, 12] it is true that for e > the Hamiltonian-Krein index associated with the 
eigenvalue problem (4.5) satisfies 

^Ham = n{C%±). 

Using, e.g., [10], we have that the negative index on the right satisfies 

n(4| s x) = n(£t) - n (((^l" 1 {-d\ + e 2 )" 174 ! fo. ("^ + e 2 y ll \d x \d^ «fo>) 
= n(£) - n (((Ctr 1 (-d 2 x + e 2 )- l/i \d x \d? fa, (~d 2 x + e 2 )- l/i \d x \d x l ip )) . 

The second equality follows from (4.2). Regarding the second quantity on the right, by the definition of L% 
we have 

<(£*)- 1 (-^ + e 2 )- 1/4 |3*|^ 1 ^(-^ + e 2 )- 1/4 |a x |3; 1 Vo> = 

{C- l {-d 2 x + e 2 Y l/2 \d x \d- 1 {-d 2 x + e 2 y l/2 \d x \d- 1 ^). 

Note that the expression £~ l [{-d 2 + e 2 )~ 1/2 \d x \d~ 1 xp ] makes sense, since (-d 2 + e 2 )~ 1/2 \d x \d x 1 Tpo 6 ker(£) x . 
Since (-d 2 + e 2 )~ l ^ 2 \d x \d~ l to — > d x l to in L 2 (1R) sense, we have 

(£-1 (_d 2 + e 2 )- 1/2 \d x \d x l il> , (-d 2 x + e 2 )- 1/2 \d x \d x l ip ) -> (C-'d- 1 ip , 9- Vo)- 

It follows that for all e > sufficiently small 

n ((C- 1 {-d\ + e 2 r in \d x \d x l ip , (-d 2 x + e 2 r 1/2 \d x \d x l to)) = n({r l (d x l to), d x l <fo». 

Putting this all together, we see that the Hamiltonian-Krein index for e > small satisfies 

^Ham = n <£) " nf^" 1 id, 1 to), d- 1 to))- 

Since the quantity on the right is e-independent, and since the index is integer-valued, we can take the limit 
as e — » + and conclude that for the original eigenvalue problem (3.2), 

*Ham nUC-^d-^o), d- 1 to)). 

In other words, the Hamiltonian-Krein index for the equivalent problem (3.2) does not depend at all on the 
reformulation of the eigenvalue problem, and can be stated in terms of the original operators d x and £. 

Finally, recall that the reformulated eigenvalue problem assumed that all of the eigenfunctions resided 
in H~ 1//2 (1R). Since the eigenfunctions associated with nonzero eigenvalues must reside in H _1 (1R), the index 
for the original eigenvalue problem (1.1) must be the same as for the reformulated problem. This allows us 
to conclude with the following: 
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Theorem 4.3. Consider the eigenvalue problem 

d x Cu = Am, we L 2 (1R), 
where the self-adjoint operator £ satisfies D(£) = H s (1R)for some s > 0. Assuming that 

(£- 1 (5-Vo),^> )^0, 

£/ie Hamiltonian-Krein index satisfies 

K Ham = n(£) - n ( {/T 1 jfo), d; 1 ft,)) . 

Remark 4.4. The result of Theorem 4.3 is the one that would be expected if the skew operator d x had a 
bounded inverse. On the other hand, when considering the eigenvalue problem on the space of spatially 
periodic functions, the index satisfies 

K Ham -n(£)-n(D), D-^ (jC -l ( ^l^ )fl> (jC -l (1)fl> 

[5, 6]. The (1,1) term in the matrix D is exactly that as seen in the above theorem. In this latter case, the 
additional terms in D arise from the fact that ker(3 x ) = spanjl}: this kernel is not present when considering 
the problem on the whole line in the space L 2 (1R). In both cases the eigenfunctions associated with nonzero 
eigenvalues must have mean zero, but interestingly enough it is only in the latter case that this restriction 
actually has an effect on the index. 



5. Applications to KdV-like problems 



Consider an evolution equation written in the form 

d t u = d x U'(u), (5.1) 

where H(u) : H e QR) i-» K is some smooth energy functional. It is assumed that solutions are invariant under 
spatial translation, and that there are no other symmetries present in the system. In traveling coordinates 
£ = x - ct the equation can be rewritten as 

d,U = G*£ [H'(u) + cu] . 

For a given a e M the solitary wave solutions U c will satisfy 

H'(U c ) = -cU c + a. (5.2) 

It will be assumed that these solutions are smooth in the wave-speed over some nonempty interval. It will 
further be assumed that U c e H k {M) for some k > 1 and all c. 
The linearized eigenvalue problem is given by 

d 6 £u = Xu, £:=H"(U c ) + c. (5.3) 

Since solutions are invariant under spatial translation, it is the case that 

c(d i u e ) = o. 

By assumption it is clearly the case that d^U c e H _1 (IR). Now, differentiating the existence problem (5.2) 
with respect to c yields 

£(d c U c ) = -U c d c U c = -£- l {U c ). 

As a consequence, upon making the equivalence that = d^U c in the statement of Theorem 4.3, it is seen 
that d^ l Tp = U c and hence 

{£- l dfip Q ,dl Vo) = -<d c U c , U c ) = -\d c {U c , U c ). 

Defining p(a) = 1 for a > and p(a) = for a < 0, the Hamiltonian-Krein index for the eigenvalue problem 
(5.3) can then be stated as: 
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Theorem 5.1. Consider the KdV-like evolution equation (5.1). Let U c be a solitary wave -which solves (5.2) and 
satisfies the properties proscribed above. Let 

C := H"(U c ) + c 

be the linearization about the wave in traveling coordinates. Assume that 

ker(£) = span{d 4 U c }, d c (U c , U c ) * 0. 
The Hamiltonian-Krein index for the linearized eigenvalue problem (5.3) is then 

K mm =n(C)-p(d c (U c ,U c ))- 

Remark 5.2. Since k c and are even integers, the underlying wave will be spectrally unstable with fc r > 1 
if ^Ham is odd. 

Remark 5.3. From Theorem 5.1 we (partially) recover the following well-known result. Suppose that n(£) = 
1. If d c {U c , U c ) > 0, then under some additional genericity conditions it is known that the wave is orbitally 
stable [4] (also see [9, Chapter 5]). As we see from Theorem 5.1, under this scenario Kn am = 0, so that all of 
the spectra is purely imaginary, and any (embedded) eigenvalues must have positive Krein signature. On 
the other hand, if d c {U c , U c ) < 0, then K^m - 1 implies that k T = 1, which corroborates the Evans function 
calculation of Pego and Weinstein [15, 16]. 

5. 1 . Fractional KdV equations 

The exact form of C in Theorem 5.1 is unimportant, as long as the desired properties hold. Thus, as a 
generalization of the above we obtain the following result of Lin [14, Theorem 1] concerning the more 
general KdV-type equation 

d t u-d x (Mu-f(u)) = 0, (5.4) 

where / e C 1 , /(0) = /'(0) = 0, and the operator M is defined through its Fourier symbol via Mg(£,) = 
a{E,)g{E,). Examples of this type include the KdV equations (and its generalizations) with M. - —d\, the 
Benjamin-Ono equation with M. = \d x \, etc. We henceforth will assume that the multiplier a(E, ) is a contin- 
uous function of its argument with lim^i^^ a(£) = oo. 

Corollary 5.4. For the generalized KdV-type equation (5.4) assume that the linearized operator £ = M.+c-f'(U c ) 
satisfies the original assumptions (a), (b), (c) with 

kev(C) = {d i U c }. 

The Hamiltonian-Krein index for the spectral problem d^Lu = Xu is 

K mm =n(£)-p(d c (U c ,Uc)). (5.5) 

In particular, 

• the wave U c is spectrally unstable if -K" Ham is odd, i.e., 

- n(£) is even and d c (U c , U c ) > 

- n(£) is odd and d c (U c , U c ) < 

• the wave U c is spectrally stable if n(£) = 1 and d c (U c , U c ) > 0. 

One should compare these results with the corresponding results of Lin [14, Theorem 1] for KdV-type 
equations. In particular, we do not require the multiplier a(£) to have any specific form, like a(E.) ~ 
but only the natural conditions 

• M + c > 6 2 1 > for some b > 0, 
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• f'(U c ) is a relatively compact perturbation of M. + c. 

The condition M. + c> b 2 X is satisfied by simply requiring that a(£.) > and c > 0, in which case, we may 
select 8 - c/2. The relative compactness of f'(U c ) follows from any (even power) decay of U c at infinity as 
well as any (even power) decay of the kernel of {M + c) -1 , which is given by 

f +00 1 

K(x)= e 2mi *d£. 

J-c c + a(5) 

This last condition is satisfied, under very mild growth requirements of a. To see this, an easy integration 
by parts argument implies 



C_ r°° \a'( 
W J-oo (c + a 



\K(x)\<-\ ■ 1 ," dl 



(0_ 



This allows us to formulate more specific and easily verifiable conditions which imply that the essential 
spectrum assumption (b) is satisfied: 

Proposition 5.5. Let c > and the wave U c and the multiplier a satisfy 

• U c has some power decay at oo, 

• the Fourier multiplier a(£,) 

- is a continuous differ entiable a.e. function with a(£,) > and lim^^^ a(£) = oo, 



- satisfies the estimate 



■J—t 



(c + a(0) 



■d£<oo. (5.6) 



Then M + c > 8 2 I, and f'(U c ) is a relatively compact perturbation of M. + c. In other words, requirement (b) for 
the operator C = M + c- f'(U c ) is satisfied. 

It is instructive to consider the spectral stability of the traveling wave U c (x) = 4c/(l + c 2 x 2 ) of the 
Benjamin-Ono equation 

d t u - d x (\d x \u - u 2 j = 0. 

The orbital stability of these waves has already been established by Albert and Bona [1] and Albert et al. 
[2]; hence, this wave is spectrally stable. An alternative approach is to use the approach of Corollary 5.4 
and use the spectral information provided by the work of Amick and Toland [3]), see the remarks after 
Theorem 5.6. 

In fact, we have more general result, which is applicable to the so-called fractional KdV equations (or, 
fractional Benjamin-Ono equation as they are referred to in [7]) 

d t u-d x (\d x \ s u-uP +1 ) = 0. (5.7) 

Using the traveling wave ansatz U c (£), <J = x — ct with c > in (5.7) (and requiring that U c vanishes at +oo) 
leads us to the existence equation 

|^| s U c + cl/ c -l/ c p+1 =0 (5.8) 
An elementary scaling analysis then shows that U c (£.) = c l ^P Q(c l ^ s E,), where Q satisfies 

\dt\ s Q + Q-Q p+1 =0. (5.9) 

Assume that < s < 2, and set 

, . [ls/(\-s), 0<s<l 
l+oo, 1 < s < 2. 

It was recently shown by Frank and Lenzmann [7] that if < p < p max (s), then (5.9) has an unique (up to 
translation) ground state solution Q which is positive and bell-shaped, i.e., even and decreasing in (0,oo). 
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In addition, the solution Q has decay as £ — » +00; in fact, |Q(£)| < C\E,\ 1 (see [7, Lemma 5.6]). Furthermore, 
its linearized operator, 

C + = \d,\ s + l-(p + l)QP, 

satisfies n(£ + ) = 1, the kernel is simple with ker(£+) = spanje^Q}, and the rest of the spectrum is posi- 
tive, with a spectral gap at the zero. A simple rescaling then implies that similar statements hold for the 
linearized operator 

C c = \d s \ s + c-(p + l)U?. 

Going back to the linearized stability of U c , we see that we need to consider the eigenvalue problem 

d^C c z = Az. 

By the decay of Q, the relative compactness of L/f follows easily (indeed, note that the condition is satisfied 
for when the multiplier is a{E) = |£| s for any s > 0). Thus, we can apply Corollary 5.4 to conclude that 

K Ham = l-p(d c (U c ,U c )). 

The stability of the traveling wave U c is equivalent to the positivity of d c (U c , U c ). Since 

1 2 1\ 2-1-1 
d c (U c ,U c ) = const.l- - -\C 1 

for some positive constant, we have shown the following: 

Theorem 5.6. Let < s < 2 and < p < p max . The unique ground state traveling wave solutions U c are spectrally 
stable if 

< p < 2s. 

Otherwise, if2s<p< p max ( s ) there is precisely one positive real eigenvalue, and the rest of the spectrum is purely 
imaginary. 

Remark 5.7. The Benjamin-Ono case corresponds to the case s = l,p = 2, which is the borderline case in the 
above computation. Since in this case d c (U c , U c ) = 0, the generalized kernel for d^C c will have dimension 
of at least three. The calculation of the Hamiltonian-Krein index would have to be modified in order to take 
into account the fact that the dimension of the generalized kernel is larger than two. This is a relatively 
straightforward exercise which we will leave for the interested reader (e.g., see [10, Index Theorem 2.1] 
and the references therein for an indication as to what modifications must be made). The end result is the 
expected one: the index satisfies K Ham = 0- 

Remark 5.8. The result of Theorem 5.6 recovers the classical KdV results for the limiting case s = 2, which 
does not require the theory of [7] in order to conclude the existence of the wave U c . Here we then get the 
well-known result of spectral (which in this case implies orbital) stability for ground state solutions to the 
generalized KdV whenever p < 4, and spectral instability for p > 4. 



6. Applications to BBM-like problems 

Consider the BBM-type problem 

(2 + M)d t u + d x (u+f{u)) = 0, (6.1) 

under the same conditions on the nonlinearity / and the dispersion operator M as in Corollary 5.4. These 
problems have been considered in this generality by numerous authors; for example, see the paper [14] 
for an extensive discussion. In addition to the requirements on M. presented in the discussion leading 
to Corollary 5.4, we require that I + M > 6 2 X > 0, which hence possesses a square root and a bounded 
inverse 8 . This last requirement, in view of the form required of M amounts to the multiplier satisfying the 
inequality 1 + a(£,) > 5 2 . 

8 In the classical BBM model M = —d\, in which case the invertibility of (1 - is a well-settled issue 
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After integration in the traveling variable E, = x - ct the traveling wave solution U c 9 will satisfy the 
elliptic PDE 

cMU c {£) + (c-l)U c (Z)-f{U c ) = 0. (6.2) 
Introduce the corresponding linearized operator 

C := cM + (c-l)-f'(U c ). 

Clearly, a differentiation 10 in £ of the defining equation (6.2) yields that £q(^4^c) = ; we henceforth 
assume that ker(£g) = spanjo'j U c }. Writing u = U c (£,) + v(£,,t) in (6.1) and linearizing yields 

(I + M)d t v = d ( [cM + (c-l)-f'(U c )]v = d 6 £ v, 

which in turn yields the eigenvalue problem 

d i C Q v = X{l + M)v. (6.3) 

In order to put this linearized problem in the desired framework, we introduce the variable 

z:= (I + M) 1/2 v. 

Taking (1 + M)~ 112 on both sides of (6.3) yields the new eigenvalue problem 

d 6 [(I + M)~ 1/2 C (I + Mf 1/2 ]z = Az. (6.4) 

If A is an eigenvalue for (6.4) with corresponding eigenfunction z, then the fact that (I + 7W)~ 1//2 is 
a bounded operator implies that A is an eigenvalue for (6.3) with corresponding eigenfunction v = (I + 
M)~ l ^ 2 z. On the other hand, suppose that A is a nonzero eigenvalue for (6.3) with corresponding eigen- 
function v. Since (I + M)v necessarily makes sense, it is true that z = (1 + M) l ^ 2 v is well-defined; thus, A is 
also an eigenvalue for (6.4). In conclusion, when looking for nonzero eigenvalues the two spectral problems 
are equivalent. Denote 

£:={! + M)- 1/2 C (1 + M)~ 1/2 , 

so that the eigenvalue problem associated with (6.4) is of the desired form (1.1). We now discuss abstract 
conditions that would imply 

(a) 0ess(£) C [kI,oo), k >0 

(b) n(£) = n(£ ). 

The condition (b) is satisfied because (1 + M)~ 1 ^ 2 is a bounded and symmetric operator. Regarding (a), write 

£ = (1 + M)~ 1/2 [cM + (c- 1)](X + MY 1 ' 2 - (I + Mr l/2 f'(U c )(I + M)~ 1/2 . 
If (I + M)~ 1/2 f'(U c )(I + M)~ 1/2 is a compact operator, then 

ffess(£) = a ess ((I + M)- 1/2 [cM + (c- 1)}(I + M)- 1/2 ) = Ranged » C -^±^l] c [k 2 ,oo). 

Indeed, the last inclusion holds because of the continuity of the symbol i^rn — ®> tne ^ ac ^ * na t ca (5) + 
c - 1 > b 2 , and the limiting behavior lim^^ ^j-^j-m 1 = c > 0. On the other hand, the compactness of 

the operator (1 + M)~ 1 ^ 2 f ' (U C ){T + M)~ x ^ 2 holds under minimal assumptions on the decay of U c and the 
kernel of (1 + M)~ l , see Proposition 5.5. More precisely, to show that the kernel K of (1 + M)~ 1/2 satisfies 
\K(x)\ < C|x| _1 , we need that the multiplier a(£) satisfies 



f 

J -L 



-At, < > 



(!+«(£)) 



3/2 



9 which is henceforth assumed to be homoclinic to zero at { = ±oo and in addition, it has at least a power decay 
10 Here is where matters that M is given by multiplier, so that d^M = Md^ 
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This is certainly satisfied in the cases of interest, = |£| s ,s > 0. 

Continuing with the analysis of the operator L, we verify by a direct inspection 

£[(! + M) 1/2 d 5 U c ] = (! + M)- 1/2 (C [d 5 U c }) = 0, 

which gives a definitive relationship between the kernels of the two operators. In particular, they have the 
same dimension. Regarding the Hamiltonian-Krein index for (6.4), the fact that 
(2 + M) 1/2 d 6 U c = d s (l + M) 1/2 U C allows us to write 

(JT 1 df [(1 + M) 1/2 d s U c ], df (1 + M) 1/2 d i U c ) = (C- 1 [(1 + M) 1/2 U C ], (1 + M) 1/2 U c ), 

which in terms of the original operator yields 

<£- J [(1 + M) in U c ], (I + M) in U c ) = (£- l [(I + M) U c ], (I + M) U c ). 

Now, taking a derivative in the variable c in the existence equation (6.2) yields 

C [d c U c ] = -(l + M)U c =5 £- 1 [(I + M)U c ] = -d c U c , n 

so that 

(C- 1 [(l + M)U c },(I + M)U c )=-jd c {(I + M)U c ,U c ). 

Upon applying Theorem 4.3 we have now shown the following: 

Theorem 6.1. Consider the BBM-type equation (6.1), assume further that £ satisfies 

• a(£) is continuous, lim^i^o;, a(£) = oo, and ca(^) + c- 1 > b 2 > for some 3 > 

• (I + M)~ 1/2 f'{U c )(2 + M)~ 1/2 is a compact operator on L 2 (K) 

• ker(£ ) = span{5 4 U c }. 

The Hamiltonian-Krein index for the spectral problem (6.3) is 

K Ham = n(£ ) - p (9 C ((I + M)U C , U c )). 

In particular, 

• the wave U c is spectrally unstable ififKn am is odd, i.e., 

- n(£) is even and d c ((2 + M)U C ,U C ) > 

- n(£) is odd and d c ({l + M)U C , U c ) < 

• the wave U c is spectrally stable ifn(C) = 1 and d c {(I + M)U C , U c ) > 0. 

Remark 6.2. Comparing these results with the corresponding results of Lin [14, Theorem 1], we see that 
regarding the requirements on the multiplier a(£), they are slightly more general than the ones proposed 
by Lin (see also Proposition 5.5). 

6.1. Fractional BBM Equations 

We are now ready to characterize the spectral stability of the ground state traveling wave solutions of the 
fractional BBM equation, which is given by 

d t u + d x u + 9 t (\d x \ s u) + d x ( U P +1 ) = (6.5) 

^This relationship is a verification, via the Fredholm alternative, that (I + M)U C e kerf^g)^ 
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(compare with (6.1)). In the traveling wave ansatz U c (£,) with E, =x — ct we obtain the existence equation 

cVS^Uc + ic-lWc-Ur 1 =0. (6.6) 

Under the assumption c > 1, which is necessary for the existence of such waves, we see that matters once 
again reduce to the solution Q of (5.9). Indeed, the solution U c of (6.6) can be written as 

U c (x) = (c-\) y PQ 

Next, we verify that the operator £ = c l^f P + i c ~ 1)~ (p + l)^c satisfies the requirements of Theorem 6.1 
for any c > 1 and s > 0. Indeed, letting the multiplier satisfy a(£) = |£| s , we see that ca(£) + c- 1 > c-1 =: 5. 
Similar to the claims of Proposition 5.5, we use the decay of Q (and U c , respectively) to conclude that 
the operator (I + \d^\ s )~ 1/2 U c (I + \d^\ s )~ 1/2 is a compact operator on L 2 (IR). Finally, ker(£ ) = span{<9,c U c \ and 
n(£o) = 1 is a consequence 12 of the corresponding statement for the operator C + of Frank and Lenzmann 
[7]- 

Thus, we may apply our formula for the Hamilton-Krein index from Theorem 6.1. To this end, we need 
to compute d c ((2 + M)U C , U c ), which from the defining equation (6.6) is expressible as follows 

((I + M)U C , U c ) = l(U c + U V c + \ Uc) = (c- l)'~'cH<Q,Q> + (c- l) 1+ HcH<QP+l,Q>. 

It follows that 

d c {(I + M)U c ,U c ) = (c- l)p"^ _1 c^- 2 [(c(2/p- 1)+ 1 - l/s)(Q,Q) + (2c/p+l - l/s)(Q p+1 ,Q)]. 
Since c > 1, upon simplifying we have that 

d c ((2 + M)U C , U c ) oc [(2 - p)sc + (s- l)p](Q, Q) + [2sc + (5 - l)p](Q p+1 ,Q). 
Now, using the existence equation (5.9) we have that 

(Q p+ \Q) = (Q,Q) + (\d s \ s Q,Q) = (Q,Q) + (\d 6 \ s/2 Q,\d s \ s/2 Qy, 
thus, we can rewrite the above to say that 

d c ((I + M)U c Mc)^[^-p)sc+2(s-l)p}(Q,Q) + [2sc+(s-l)p}(\d i \ s/2 Q,\d l \ s/2 Q). 
This allows us to conclude with the following: 

Theorem 6.3. Let < s < 2, p e (0,p max ) and c > 1. The unique (up to translation) ground state U c of the 
fractional BBM equation (which is a solution of (6.6)) is spectrally stable if and only if 

[ (4 - p)sc + 2(s -l)p](Q,Q)>- [2sc + (s- l)p] {\d^ 2 Q, |^| s/2 Q). 

In particular, the wave is spectrally stable if 1 < s < 2 and < p < 4. If the inequality is reversed the linearized 
eigenvalue problem has precisely one positive real eigenvalue, and the rest of the spectrum is purely imaginary. 
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